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A search for lepton flavor violating decays of a t to a lighter-mass charged lepton and an u) vector 
meson is performed using 384.1 fb~^ of e'^e~ annihilation data collected with the BABAR detector 
at the Stanford Linear Accelerator Center PEP-II storage ring. No signal is found, and the upper 
limits on the branching ratios arc determined to be B{t — > e^cj) < 1.1 x 10~^ and B{t^ —> H ui) 
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PACS numbers: 13.35.Dx, 14.60.Fg, 11.30.Hv 



In the Standard Model (SM) with massless neutrinos, 
lepton number is conserved separately for each genera- 
tion. However the discovery of large neutrino mixing [l| 
requires that lepton flavor violation (LFV) occur, al- 
though decays involving charged LFV have not yet been 
observed. In minimal extensions of the SM that account 
for neutrino oscillations by the seesaw mechanism of neu- 
trino mass generation, the expected rates of LFV decays 
are too small to be observable. Thus the observation of 
neutrinoless decays like i^uj, where i = eoTLi, 

would be an unambiguous signature of new physics [2|, 
while limits on this process provide constraints on theo- 
retical models. 

The search for £^uj decays presented here 

uses data recorded by the BaBAR detector at the SLAC 
PEP-II asymmetric-energy e^e~ storage ring. The 
data sample corresponds to an integrated luminosity h— 
347.5 fb~^ recorded at an e+e^ center-of-mass (cm.) en- 
ergy -^s — 10.58 GeV, and 36.6 fb~^ recorded at ^/s ~ 
10.54 GeV. With an average cross section of Ce+e-^T+r- 
= (0.919±0.003) nb 3], this corresponds to a sample of 
3.53 X 10^ r-pair events. 

The details of the BaBAR detector are described else- 
where Charged particles are reconstructed as tracks 
with a five-layer silicon vertex tracker (SVT) and a 40- 
layer drift chamber (DCH) inside a 1.5 T solenoidal mag- 
net. An electromagnetic calorimeter (EMC) consisting 
of 6580 CsI(Tl) crystals is used to identify electrons and 
photons. A ring-imaging Cherenkov detector (DIRC) is 
used to identify charged pions and kaons. The flux re- 
turn of the solenoid, instrumented with resistive plate 
chambers and limited streamer tubes, is used to identify 
muons. 

The signature of the signal process is the presence of 
a £uj pair havingan invariant mass consistent with rrir 
= 1.777 GeV/c^ Q and a total energy equal to y/s/2 in 
the cm. frame, along with other particles in the event 
whose properties are consistent with a t decay. Only the 
dominant decay mode of the uj meson {uj —> tt+tt^tt^) is 
used in this analysis. The estimation of the background 
rate in the final sample comes from data only, while sam- 
ples of Monte Carlo (MC) simulated events are used to 
obtain the signal reconstruction efhciency, the kinematic 
distributions of the signal and background events, to op- 
timize the selection criteria and to study systematic un- 
certainties in the signal efficiency. Control samples with 
two identified electrons in the event are used to study 
background contamination from radiative Bhabha scat- 
tering, since the relevant cross-section is large, making it 
impractical to generate a sufficient number of simulated 
events. 

The signal events are simulated with KK2F [6], where 
one T decays to £^uj according to two body phase space 



and the other r decays according to measured branching 
fractions [3 simulated with TAUOLA The ^J,'^^J-~ and 
T+r^ background processes are generated using KK2F 
and TAUOLA, and qq processes are generated using the 
EVTGEN ji] and JETSET [Hi] packages. The detector re- 
sponse for the MC events is simulated using the GEANT4 
package [lH. Radiative corrections for signal and back- 
ground processes are simulated using PHOTOS 12]. 

Events with four well-reconstructed tracks and zero to- 
tal charge are selected, where no track pair is consistent 
with being a photon conversion in the detector material. 
Each event is divided into two hemispheres in the cm. 
frame by a plane perpendicular to the thrust axis .13], 
calculated using all reconstructed charged and neutral 
particles. The events having 3-1 topology, where the 
signal-side hemisphere contains three tracks and the tag- 
side contains one track, are selected. 

Photon candidates are required to have the measured 
energy in the EMC greater than 0.1 GeV to reduce the 
background originating from the e^e~ colliding beams 
in the accelerator beam pipe. Pairs of these photons 
are combined to form tt'^ candidates, with the invariant 
mass in the range 771(77) € [0.115,0.150] GeV/c^. The 
Lu mesons are reconstructed from two oppositely charged 
pion candidates combined with a tt", with the invariant 
mass in the range m(7r+7r-7r°) e [0.760,0.805] GeV/c^. 
In the i^cu decay, two of the tracks in the signal- 

side hemisphere have the same charge. Each of these 
two same-sign tracks is combined independently with the 
opposite-sign track and the neutral pion to form two uj 
candidates. The candidate with invariant mass nearest 
to the nominal u mass [3] is considered to be the signal 
Lu. The signal track that is not combined to form the uj 
candidate is required to have a momentum in the labora- 
tory frame greater than 0.5 GeV/c and to be identified as 
an electron or muon as appropriate, using BaBAR parti- 
cle identification techniques [IJ] . The three tracks in the 
signal-side hemisphere are fitted to a common vertex, and 
the photons from the tt'^ are assumed to originate from 
this vertex. The reconstructed 7r° candidate from the 
signal T is constrained to the nominal 7r° mass [71 . The 
UJ candidate is then combined with the lepton track to 
form the signal t candidate. The signal-side hemisphere 
may contain up to four photons so as to allow hadronic 
split-offs from the pion tracks in the EMC. Thus, there 
may be more than one tt^ candidate, resulting in multi- 
ple T candidates. In this case, the iuj combination with 
invariant mass closest to the nominal r mass is accepted 
as the signal r candidate. From a sample of 1.6 x 10^ 
generated signal MC events, all the reconstructed signal 
candidates are verified to have correct association with 
the truth-matched signal t decays. 

Signal events are distinguished by two kinematic vari- 
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ables: the beam-energy constrained mass (mEc) and the 
energy difference AE = Ei + E^^ — \/s/2, where Eg and 
Ei^ are energies of the lepton and the to in the cm. frame. 
The mEC is calculated from a fit to the reconstructed r 
candidate decay products with a constraint that the r 
energy is equal to y/s/2 in the cm. frame. These two 
variables are weakly correlated and have non-Gaussian 
tails due to initial and final state radiation. For the signal 
MC events, the ttiec distribution peaks at nir, while the 
AE distribution peaks close to but below zero, primar- 
ily due to photon energy reconstruction effects produc- 
ing a small negative offset in the reconstructed r energy. 
The peak positions (toeci AE) and standard deviations 
(CT(mEc), <^{^E)) of the m^c and AE distributions for 
the reconstructed signal MC events are presented in Ta- 
ble m To study signal-like events, a large box (LB) is 
defined in the ttiec vs. AE plane as: mEC & [1-6, 2.0] 
GeV/c^ and AE e [-0.8,0.4] GeV. To avoid experi- 
menter bias, the number and the properties of data events 
falling within the ±3cr rectangular region in the mEc-AE 
plane, defined as the signal box (SB), are neither used to 
optimize the selection criteria nor to study systematic 
effects. The region inside the LB but outside the SB is 
called grand side band (GSB) and is used for estimation 
of the background contribution in the SB. The selection 
requirements are optimized to yield the lowest expected 
upper limit (UL) [la ] derived from the events inside the 
SB under a background-only hypothesis. 

To suppress non-r backgrounds with radiation along 
the beam direction, the polar angle of the missing 
momentum with respect to beam axis (0miss) is re- 
quired to lie within the detector acceptance: cos ^miss G 
[—0.76,0.92]. The total cm. momentum of all tracks 
and photon candidates in the tag-side must be less than 
4.75 GeV/c. 

The events are classified into four different categories 
depending on tag-side hemisphere properties: the par- 
ticle identification for the track and the total neutral 
cm. energy in the hemisphere {S E^J^^j.^{) . If the tag-side 
track is identified as an electron or a muon it is catego- 
rized as an e— tag or a /x— tag. Otherwise it is categorized 
as an /i— tag or a p— tag, depending on whether ^-Ei^^trai 
is less than or greater than 0.2 GeV. The e— tag events 
are not used in the final selection of e^ui candi- 

dates, but are used as the control sample to estimate the 
Bhabha contribution to this decay mode. 

The tag-side hemisphere is expected to contain a SM r 
decay characterized by the presence of one charged par- 
ticle and one or two neutrinos. The missing mass due 
to the undetected neutrino(s) is reconstructed as m,^^ = 
(ptag_p^tag^2^ where P*'"^ and P^^f are four-momenta in 
the cm. frame. The energy and momentum components 
of P*^s are {y/s/2, ^ (s/4 — jtIt-^) • n) where h is the unit 
vector opposite in direction to the signal-side r momen- 
tum and is the combined four-momentum in the cm. 
frame of all the tracks and photon candidates observed in 



the tag-side hemisphere. To reduce non-r backgrounds, 
tag-dependent requirements on mj^ are applied for the 
fj.'^uj candidates. For e— tags and /i— tags, m^'^ 
must be in the range € [-2.0, 2.5] GeVVc" whereas for 
/i— tags and p— tags, m^^ G [—1.2,2.0] GeV^/c'* and m^'^ 
e [-2.0,0.5] GeVVc*, respectively. For the t± ^^uj 
candidates, the ratio p^^^^/^/s in the cm. frame is re- 
quired to be greater than 0.061, where p^igg is the compo- 
nent of the missing momentum of the event transverse to 
the beam direction. For e^uj candidates, Pmiss/\/* 

is required to be greater than 0.034. 

After applying all the selection criteria for e^uj 
and — > fi^uj decays, the number of data events surviv- 
ing inside the GSB are 39 and 502, respectively, as shown 
in Fig. [1] The number of background events in the MC 
and control samples, in the same region and passing the 
same set of requirements as data, is 35±6 for — > e^uj 
and 564±26 for r± ^i^uj decay. Out of these MC 
background events in the — > e^ui decay, the domi- 
nant contributions are from qq (54%) and r+T~ (34%); 
the rest arise from radiative Bhabha scattering. About 
92% of the background in fi^uj decay is from r+r" 

events; within this category, 94% are due to the decay 
—)■ 27r^7r+7r'^i/, where one of the charged pions is mis- 
identified as a muon. The number of background events 
in the — > /i^w sample is more than — > e^ur be- 
cause of the larger mis-identification rate for a pion track 
to be identified as a muon than an electron. 

The number of expected background events in the SB 
is extracted from an unbinned maximum likelihood fit 
to the mEC and AE distributions of data events inside 
the GSB, using a two-dimensional probability density 
function (PDF) made of a linear combination of PDFs 
representing each background component, e^e~, 
T+r~ and qq. The MC event samples are used to deter- 
mine each component PDF but the one describing radia- 
tive Bhabha events, for which a data control sample is 
used. Each PDF is obtained by interpolating the two- 
dimensional binned distribution of its respective sam- 
ple using Gaussian weight terms that are fit with an 
adaptive kernel estimation procedure [l6[ . The expected 
background normalization is fixed to the amount of data 
events in the GSB, while the relative yields of the differ- 
ent background components are fitted to the background 
shape. The numbers of background events expected from 
this fit for various regions around the SB are compared 
with the numbers observed in Table [III and they confirm 
that the backgrounds in the data are adequately mod- 
eled. 

Systematic uncertainties on the signal efficiency and 
the estimated background are considered in this mea- 
surement. The uncertainty due to knowledge of the ef- 
ficiencies for trigger, for the tracking, and in the beam 
energy scale and spread is 1.4% for both decay modes. An 
uncertainty of 2.0% originates from uncertainties on the 
lepton track momentum and on the photon energy scale 
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FIG. 1: The selected candidates (dots) inside the large box region of the m^c-^E plane for r — > e uj (left plot) and 
)j,^uj (right plot) decays. The ±3cr signal box is shown by a dashed rectangle. The dark and light shading indicates 
contours containing 50% and 90% of the selected MC signal events, respectively. The signal box contains 67% of the selected 
MC signal events for e^uj and 77% for ji^uj decay. 



TABLE I: The peak positions and standard deviations of the m-EC and AE distributions, obtained from the fit to the signal MC 
events. Also shown are the reconstruction efficiencies (e), the number of expected background (exp.) events and the observed 
(obs.) events inside the signal box, and the resuhing upper limits at 90% confidence level (C.L.) including the systematic 
uncertainties. 



Decay modes 


JTT-EC 


o-(mEc) 


AE 


a{AE) 


e 


SB events 


UL (xlO"'^) 




MeV/c^ 


MeV/c^ 


MeV 


MeV 


(%) 


exp. obs. 


exp. obs. 




1777.4±0.1 


6.8±0.1 


-14.4±0.3 


32.2±0.3 


2.96±0.13 


0.35±0.06 


1.4 1.1 


— » /i^o; 


1777.7±0.1 


6.4±0.1 


-11.2±0.2 


30.9±0.3 


2.56±0.16 


0.73±0.03 


1.7 1.0 



TABLE IL The expected number of background events obtained from the fit to ttiec —AE distributions within the ±(3— 5)(t, 
±(5— 7)(T, ±(7— 9)cr, ±(9— ll)cr and the combined ±(3— 11)(t nested rectangular regions centered around the signal box. Also 
shown are the number of observed events inside the corresponding regions. 



Decay modes 


# of events 


±(3-5)(T 


±(5-7)cr 


±(7-9)(T 


±(9-ll)(j 


±(3-11)ct 


r± ^ e^LO 


expected 


0.6±0.1 


1.0±0.2 


1.4±0.2 


1.9±0.3 


4.9±0.8 




observed 








1 


2 


3 


— > /i^oj 


expected 


1.9±0.1 


3.9±0.2 


6.7±0.3 


12.1±0.5 


24.6±1.1 




observed 


2 


3 


7 


10 


22 



and resolution, which affect the position and spread of 
the Ai? and mEc distributions. There is a 3.3% uncer- 
tainty in the tt" reconstruction efficiency, the uncertainty 
in lepton identification is 1.1% for electrons and 4.5% 
for muons, and there is a 1% uncertainty on the number 
of r pairs produced. After combining these individual 
contributions in quadrature, the total systematic uncer- 



tainty on efficiency is 4.4% for 



and 6.2% for 



r fi UJ. The uncertainties on background estima- 
tion are determined by the background fit errors. The 



uncertainty due to MC statistics is negligible. 

The signal is simulated according to the two body 
phase space, i.e. with a uniform distribution of the cosine 
of the helicity angle with respect to the r spin. Since r 
pairs are produced with spin correlation, the event se- 
lection efficiency may be sensitive to the helicity angle 
distribution of the i^co decay, which depends on 

the model of the LFV interaction 17| . This effect is sim- 
ulated by weighting the generated events to match the 
helicity angle distributions of both V — A and V + A in- 
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teractions and its consequences on the measured upper 
limit is found to be negligible. 

The upper limits for £^lu decays are calcu- 

lated using Bfj\ = N^°^/{2LarrBe), where N^p^ is the 
90% C.L. upper limit on the number of signal events in- 
side the SB, S is the branching fraction [7| of the decay 
u! 7r+7r~7r° (7r° — > 77) and e is the reconstruction effi- 
ciency of the signal decay mode under consideration. The 
expected and observed upper limits, including all contri- 
butions from systematic uncertainties, are calculated us- 
ing the technique of Cousins and Highland with the 
implementation of Barlow [l^. No signal is found, and 
the upper limits on the branching ratios are determined 
to be e(r± ^ e±w) < 1.1 x 10"^ and 6(t± ^ 
< 1.0 X 10^^ at 90% confidence level, as shown in Ta- 
ble D 
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